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ABSTRACT. 


We  present  an  example  of  the  application  of  Lie  algebraic 
techniques  to  nonlinear  estimation  problems.  The  method  relates 
the  computation  of  the  (unnormalized)  conditional  density  and 
the  computation  of  statistics  with  finite  dimensional  estimators. 
The  general  method  is  explained;  for  a  particular  example,  the 
structures  of  the  Lie  algebras  associated  with  the  unnormalized 
conditional  density  equation  and  the  finite  dimensionally 
computable  conditional  moment  equations  are  analyzed  in  detail. 
The  relationship  between  these  Lie  algebras  is  studied,  and  the 
implications  of  these  results  are  discussed. 

V 


DTIC 

ELECTE 
0CT3  1880 


*.  Supported  in  part  by  the  Air  Force  Office  of  Scientific  Research 
(AFSC)  under  Grant.  AK0SR- 79-0025,  in  part  by  the  National  Science 
Foundation  under  Grant  ENG  76-11106,  and  in  pn^t  by  the  Joint 
Services  Electronics  Program  under  Contract  F  49620-77-C-0101 . 


Filterdag  Rotterdam  1980,  M.  Hazewinkel,  Editor,  Report  of  the 
Econometric  Institute,  Erasmus  University,  Rotterdam,  1980. 


Appuwrt  for  public  rolsoio  | 


_  j  ^  _  ^Approved  for  ** 

80  1  On  6  1 0  0“*"“"“°° 1101 


AIR  FORCE  OFFICE  OF  SCIENTIFIC  RESEARCH  (AFSC) 
HOTICS  OF  TRANSMITTAL  TO  DDC 
This  technical  report  has  been  reviewed  arid  is 
approved  for  public  release  IAf?  AFR  190-18  (7b) • 
Distribution  is  unlimited. 

A.  D.  BLOSS 

Technical  Information  Officer 


1.  INTRODUCTION. 


This  paper  is  concerned  with  the  optimal  recursive  estimation 
of  the  state  x^  of  a  nonlinear  stochastic  system,  given  the  past 
observations  z  »  {z  ,  0  <  s  <  t).  Specifically,  we  consider  systems 
of  the  form 

dxfc  -  f(xfc)dt  +  G(xt)dwt 

<»  » 

dzt  *  h(xfc)dt  *  R*dvt 


where  w  and  v  are  independent  unit  variance  vector  Wiener  processes, 
f  and  h  are  vector-valued  functions,  G  is  a  matrix-valued  function, 
and  R  >  0.  The  optimal  (minimum-variance)  estimate  is  of  course  the 
conditional  mean  x^  ■  E[xt|zt]  (also  denoted  *t|t  or  E*Txt]); 
xfc  satisfies  the  (I to)  stochastic  differential  equation  [  1]  -  [  3] 


*  l  f (xt)  -  (xthT-xthT)R  1 (t)h]dt 
+  (xthT-JcthT)R",(t)dzt 


where  *  denotes  conditional  expectation  given  z1"  and  h  denotes  h(x  ). 
Also,  the  conditional  probability  density  p(t,x)  of  xfc  given  z 
(we  will  assume  that  p(t,x)  exists)  satisfies  the  stochastic  partial 
differential- equation  [  3] ,  [4] 


(3)  dp(t,x)  -  £p(t,x)dt  +  (h(x)-h(x))TR  1 (t) (dzt~h(x)dt)p(t,x) 


where 


(4) 


n 

£(.)  -  -  £ 

i-I 


3(.f.) 

9x. 


,  n  n 
4  £  E 

1  i-1  j-l 


a2(.(ccT)ij) 


is  the  forward  diffusion  operator. 

Notice. that  the  differential  equation  (2)  is  not  recursive,  and 
indeed  appears  to  involve  an  infinite  dimensional  computation  in 
general.  Aside  from  the  linear-Gaussian  case  in  which  the  Kalman  filter 
is  optimal,  there  arc  very  few  known  cases  in  which  the  optimal  estimator  is  fin 
dimensional  (a  number  of  these- arc  summarized  in  [5]).  However,  in  [  6) 

-  t 8]  we  have  shown  chat  for  certain  classes  of  nonlinear  stochastic 


systems  in  continuous  and  discrete  time,  the  conditional  mean  can  be 
computed  with  a  recursive  filter  of  fixed  finite  dimension.  The  typical 
nonlinear  system  in  these  classes  consists  of  a  linear  system  with 
linear  measurements,  which  feeds  forward  into  a  nonlinear  system 
described  by  a  certain  type  of  Volterra  series  expansion  or  by  a  bilinear 
system  satisfying  certain  algebraic  conditions.  The  major  purpose  of 
this  paper  is  to  consider  these  estimation  problems  from  a  new  perspective, 
and  to  gain  much  deeper  insight  into  their  structure. 

The  new  perspective,  originally  proposed  by  Brockett  t9]  (see 
also  t  10],  l  111),  takes  the  following  approach  to  the  general  estimation 
problem  (1)  (we  assume  for  simplicity  that  z  is  a  scalar).  Instead  of 
studying  the  equation  (3)  for  the  conditional  density,  we  consider 
the  Zakai  equation  for  an  unnormalized  conditional  density  p(t,x) 

l  12]: 


(5)  dp(t,x)  »  tp(t,x)dt  ♦  h(x)p(t,x)dzt 
where  p(t,x)  is  related  to  p(t,x)  by  the  normalization 

(6)  p(t,x)  -  p(t,x).(/p(t,x)dx)”1 . 


The  Zakai  equation  (5)  is  much  simpler  than  (3);  indeed,  (5)  is  a 
bilinear  differential  equation  [  13]  in  P,  with  z  considered  as  the  input. 
This  is  the  first  clue  that  the  Lie  algebraic  and  differential  geometric 
techniques  developed  for  finite  dimensional  systems  of  this  type  may  be 
brought  to  bear  here.  Suppose  that  some  statistic  of  the  conditional 
distribution  of  x£  given  zC  can  be  calculated  with  a  finite  dimensional 
recursive  estimator  of  the  form 

Accession  For 

NTIS~  GRAM 
DTIC  TAB 
Unannounced 
Justification-^. 


(7)  dnt  -  a(nt)dt  ♦  b(nt)dzt 


(8) 


E[c(xt)|*t]  -  y(nt) 


where  n  evolves  on  a  finite  dimensional  manifold,  and  a  and  b  are 
suitably  smooth.  Of  course,  this  statistic  can  also  be  obtained  from 
p(t,x):  by 


Codes 
/or  ~~ 


1 Al 


□q 


(9)  Etc(xt)|zt]  -  I  c(x)p(t,x)dx  (/p(t,x)dx) 


For  Lie-algebraic  calculations,  it  is  more .convenient  to  write  (5) 

and  (3)  in  Fisk-Stratonovich  fore*  (so  that  they  obey  the  ordinary  rules  of 

calculus) 


(10)  dnt  »  a(nt)dt  +  b(nt)dzt 


(II)  dp(t,x)  *(£  -  ■j  h  (x)Jp(t,x)dt  +  h(x)p(t,x)dzt 

th  -v  3b- 

where  the  i—  component  a.'(n)  "  a.(n)  -  |  I!  b.(n)-r-^  (n) 

i  1  #i  an  • 

j  i 

(Beginning  with  (10),  all  equations  will  be  in  Fisk-Stratonovich  form, 

unless  otherwise  indicated).  The'  two  systems  (10),  (8)  and  (11),  (9) 

are  thus  two  representations  of  the  same  mapping  from  “input”  functions 

z  to  "outputs  "  El  c(xt) | zC):  (11),  (9)  via  a  bilinear  infinite  dimensional 

state  equation,  and  (10),  (8)  via  a  nonlinear  finite  dimensional  state 

equation.  Generalizing  Che  results  oft  14),  [  15)  to  infinite  dimensional 

state  equations,  the  major  assertion  of  (9)  is  that,  under  appropriate 
•  % 

hypotheses,  the  Lie  algebra  F  generated  by  a  and  b  (under  the  commutator 
I  a,b]  **  a  -  ^  b)  is  a  homomorphic  image  of  the  Lie  algebra  L 
generated  by  Aq  *  1  -  j  h3(x)  and  Bo  ■  h(x)  (under  the  commutator 
l  Ao,Bo)  *  AQBo“BoAo) .  Conversely,  any  homomorphism  of  L  onto  a  Lie 
algebra  generated  by  two  complete  vector  fields  on  a  finite  dimensional 
aianifold  allows  the  computation  of  some  information  about  the  conditional 
density  with  a  finite  dimensional  estimator  of  the  form  (10). 

In  (9),  this  approach  is  explicitly  carried  out  and  analyzed  for 
the  problem  in  which  f ,  C  and  h  (I)  in  are  all  linear.  In  that  case, 
the  Lie  algebra  L  of  the  Zakai  equation  is  finite  dimensional  and 

the  unnormalized  conditional  density  can  in  fact  be  computed  with  a 
finite  dimensional  estimator  ,  the  Kalman  filter.  In  this  paper,  we  carry 
out  a  similar  analysis  for  the  simplest  example  of  the  class  considered 
in  ( 6]  -  (8).  For  this  example,  all  conditional  moments  of  the  state  can  be 
computed  with  finite  dimensional  estimators;  the  Lie  algebra  L  is  infinite 
dimensional  but  has  many  finite  dimensional  homomorphic  images  (the  Lie 
algebras  of  the  finite  dimensional  estimators),  thus  yielding  a  very 
interesting  structure.  The  example  to  be  considered  has  state  equations 


(12) 


dx  ■  dw 
t  t 


dyt  ’  Xtdt 


with  observations 


(13) 


dzfc  ■  xfcdt  +  dvfc 


where  v  and  w  are  unit  variance  Wiener  processes,  {xo,yo,v,w}  are 
independent,  and  xq  is  Gaussian.  The  computation  of  x^  is  of  course 
straightforward  by  means  of  the  Kalman  filter,  but  the  computation 
of  requires  a  nonlinear  estimator. 

2.  TOE  LIE  ALGEBRA  OF  THE  UNNORMALIZED  CONDITIONAL 
DENSITY  EQUATION. 

For  the  system  (12)  -  (13),  the  equation  (5)  in  Fisk-Stratonovich 
form  is 

2 

(IA)  dp(t,x)  «  (~x2-|—  ♦  "  ■jx2)p(t,x)dt  +  xp(t,x)dzt, 

y  3x 

2  3  I  j  2 

so  the  Lie  algebra  L  is  generated  by  A  *  -x  ♦  •j  — j  ~  ‘J*  atM* 

°  '  3x 

-  x. 
o 

The  following  theorem  is  straightforward  to  prove. 

Structure  theorem  1 : 


(i)  The  Lie  algebra  L  generated  by  An  and  Bn  has  as  basis  the  elements 

,  i 

3* 


o  o 

AQ  and  B^,  C.,  D^,  i  -  0,1,2,  ...,  where 


**  '  *  ay1 
r  .  3  lL 

31 

D.  -  — — T 
i  .  x 

3y 


l  *  0| I |2| « i • 

i  *  0| I |2| i i • 

i  *  Of  1 f 2f i « • 


(ii)  The  commutation  relations  are  given  by 


[Ao,B.l  -  C.,  Vi 


[A<),Ci]  ■  ♦  2Bi+l' 


V  i 


Uo,Dj]  -  [B..D.]  »  [C.,D.]  «  0,  V  i,j 

tBi.C.)  --Di+j,  Vi.j 

lBi,Bj]  -  [C.,^]  -  0,  V  i  /  j 

(iii)  The  center  of  Lis  {D^,  i  «  0,1,2,...}. 

(iv)  Every  ideal  of  L  has  finite  codimension;  i.e.,  for  any  ideal  I, 
the  quotient  L/Z  is  finite  dimensional. 

(v)  Let  Ij  be  the  ideal  generated  by  B^ ,  with  basis 

(B. ,C. ,D. ;  i  >  j}.  Then  IQ  =>  1 }  3  ...  and  n  I j  “  {0} ,  so 

that  the  canonical  nap  ir :  A  -*■  0  A/I.  is  injective. 

j  J 

(vi)  L  is  the  semidircct  sum  [18]  of  Aq  and  the  nilpotent  ideal 

I  ;  hence  L  is  solvable, 
o 

In  light  of  the  remarks  in  the  previous  section,  it  should  be 
expected  that  many  statistics  of  the  conditional  distribution  can  be 
computed  with  finite  dimensional  estimators,  since  there  are  an 
infinite  number  of  finite  dimensional  quotients (homomorphic  images) 
LA  .  By  Ado's  theorem,  these  can  be  realized  by  bilinear  systems. 
However,  wc  will  present  a  slightly  different  realization  of  the 
sequence  of  quotients  in  (vi)  above:  L/  I  j  is  realized  by  the 
Kalman  filter  for  {  L. /  I  j  is  the  oscillator  algebra  [9]  -  [  11]), 
and  L/  1«  (j  >  2)  is  realized  by  the  estimator  which  computes  5L 
and  y  lty*|z  ]  (i  -  l,2,...,j-l).  Of  course,  the  dimension  of 
L/  Ij  increases  with  j,  so  we  will  only  present  the  estimator 
equations  for  j  ■  4  in  the  next  section.  Other  sequences  of  quotients 
possessing  the  property  (vi)  can  also  be  realized  (c.g.,  those 
generated  by  the  (Cj)),  but  those  realizations  do  not  have  as  natural 
an  interpretation  in  terms  of  conditional  moments. 

The  properties  (iv)  and  (v)  of  the  structure  theorem  are  useful 
for  an  "estimation  algebra"  to  possess,  in  the  following  sense: 
they  basically  say  that  L  has  enough  finite  dimensional  quotients 


that  it  is  determined  by  their  direct  sum.  Translating  this  into 
an  estimation  context  via  the  reasoning  of  the  previous  section, 
if  we  can  realize  all  the  quotients  with  finite  dimensionally 
computable  statistics,  then  these  properties  give  us  hope  of  being 
able  to  approximate  the  conditional  density  (or  conditional 
characteristic  function)  with  a  convergent  series  of  functions  of 
these  statistics,  even  if  the  conditional  density  cannot  be 
computed  exactly  by  a  finite  dimensional  estimator. 


3.  THE  LIE  ALGEBRA  OF  THE  FINITE  DIMENSIONAL 
.  ESTIMATOR. 

The  method  of  [6]  for  computing  the  finite  dimensional  estimator 
for  9  systematically  uses  the  estimation  equation  (2)  and  the  fact 
that  the  conditional  density  of  Xt  given  z%  is  Gaussian  to  express 
higher  order  moments  in  terms  of  lower.  This  procedure  can  also  be 
applied  to  obtain  equations  for  higher  order  conditional  moments 
of  y  for  the  estimation  problem  (12)  -  (13).  The  first  three 
conditional  moments  of  y  ,  together  with  x  and  the  necessary 

v  L 

auxiliary  filter  states  are  computed  recursively  by  the  finite 
dimensional  estimator  (in  Fisk-Stratonovich  form,  with  explicit 
time>dependent  notation  omitted) : 


a  * 

-a? 

A 

K 

S0-P,2)  -It' 

9 

St  -  2Sc?p  ♦  P  -  PP,2 

8 

S(PI2’PJ3)  +  ^p(,'p|2)  “  0P"1 

d 

't 

y 

m 

2St2?  ♦  29  P  ♦  8x5  P.  ♦  ?  PP,  2  ~  4St??P  "  8x8p  -  29PP|2“  4?2p2-4pp|3 

(15) 

a 

* 

St(P|3-?,4)  ♦  ^P(P,2“P|3>  +  6<P-PPi2>  "♦p”1 

y 

382y^  +  3y^P  ♦  243cCpp  ♦  48Sc$P  ♦  24£2p2  ♦  6?pp|2 

♦  24 P?|3  -  ?y^PP|2  -  48tS?2  -  I2?PP|3  -  12£2?P2  -  24PP|4 

-  6Scf,y2p  -  24x5yp  -  48Si$P 

t 

»  « 

1 

L  ^ - - — — - - / 

where  the  nonrandom  conditional  covariance  equations  are 


P  -  I  - 


P,2  -  P  “  <P*P  )P,2 

-  2PF„  -  -  <p*p*V„ 

*1*  -  2Pp'|3  .  ppf2p|3  -  (P*P-')P14 

p<0)  -  cov(*o)  4  0;  Pl2(0)  -  P13(0)  -  PI4(0)  -  0 


The  estimator  (IS)  is  obtained  by  first  augmenting  the  state 
x  with  auxiliary  states  €,  0,  and  4;  then  the  Kalman  filter  for  the  linear 
system  with  states  I  x,£t0,$]  and  observations  x  computes  (S, £,§,$).  In 
addition,  [  P.P^tP ^ 3 ,P ( ^  1  is  the  first  row  of  the  Kalman  filter  error 
covariance  matrix;  (16)  is  obtained  by  selecting  the  corresponding 
components  of  the  Riccati.  equation.  Then  y  ,  and  y  are  seen,  after 
tedious  calculations,  to  be  computed  by  the  given  equations  (some  of  the 
calculations  are  presented  in  the  Appendix,  in  order  to  illustrate  the 
method).  The  filter  state  is  augmented  with  t  in  order  to  make  (15) 
time-invariant  thus  facilitating  the  use  of  Lie  algebraic  techniques. 

The  filter  (IS)  can  be  viewed  as  a  cascade  of  linear  filters  (  19): 

A  *  A 

[fi,(,0,9,t]  satisfies  a  linear  equation;  some  of  these  states  then  feed 
forward  and  can  be  viewed  as  parameters  in  a  linear  equation  for  the 
states  S,£,0>9tt  then  feed  forward  as  parameters  into  a  linear  equation 
for  y  ;  etc.  This  structure  is  typical  of  the  class  of  finite  dimensional 
estimators  derived  in  (6)  -  1 8). 


(ii)  The  commutation  relations  are  given  by 


[a  ,b.  ]  ■  c. 

o’  i  i 

lVci]  *  bi  -  bi+! 

Iao’c33  “  b3 


i  -  0, 1,2,3 
i  -  0,1,2 


I  b£»cjl 


i  +  j  «  1 
i  ♦  j  -  2 
i  ♦  j  -  3 
otherwise 


[a  ,d.l  -  I  b. ,d .]  »  [fc.,d.]  “  0,  V  i,j 

J  J  J 

(iii)  Let  be  the  ideal  in  Lwith  basis  D^,  i  _>  4  and 

Dq.  Then  F  is  isomorphic  to  ;  hence,  F  is  also  solvable. 

(iv)  The  isomorphism  $  between  Land  F/3^  is  given  by: 

♦  <A0)  “  «0;  ♦  (Bj)  «*  (“J)Xb., 

*(C.)  «  J-ijV,  i  -  0,1, 2, 3;  *(D.)  =  (-l)i(i!)d. ;  i  -  1,2,3; 

♦  (E)  -  0,  E  €  J'  4. 

(v)  F  is  the  semidirect  sum  of  a  and  the  nilpotcnt  ideal  generated 
by  bc. 


Remarks : 


(i)  The  estimator  (15)  is  not  quite  a  realization  of L  /  since 
Dp  is  also  in  the  kernel  of  the  homomorphism  (i.e.,  the  ideal 
I4).  However,  a  finite  dimensional  estimator  realizing  \J  I 


4 


(or  L/I j ;  for  any;)  is  easily  obtained  by  augmenting  (15)  with 
the  equation  for  the  normalization  factor  a£  for  p(t,x)  (the 
denominator  of  (6))  which  satisfies  (in  Ito  form) 


ddt  ■  St  <*t  dzt 


or  (’n  Fisk-Stratonovich  form) 

dat  "  "  4<St>Pt3atdt  +  *tatdt 


(17) 


If  (17)  is  augmented  at  the  end  of  (15),  the  Lie  algebra 
generated  by  a^  and  bQ  has  the  same  commutation  relations 
as  in  (ii)  above,  except  that 


and  d  commutes  with  all  the  other  elements.  Thus  a 
o 

realization  of  1/  1^  is  an  easy  modification  of  (15),  so  we 
will  concentrate  on  (15). 

(ii)  The  property  (v)  is  typical  of  a  cascade  of  linear  systems. 

(iii)  One  of  the  conditions  in  [  9)  for  the  existence  of  a  Lie  algebra 
homomorphism  from  L  to  the  Lie  algebra  of  a  finite  dimensional 
estimator  is  that  the  estimator  be  a  "minimal"  realization 

in  a  certain  sense.  If  we  consider  the  output  of  (15)  to  be 
y‘  and  consider  this  realization  of  the  input-output  map  from 
z  to  y  ,  then  it  can  be  verified  by  the  methods  of  [  15)  that 
the  realization  is  locally  weakly  controllable  and  locally 
weakly  observable.  This  implies  that  there  is  no  other 

realization  with  lower  dimension;  it  is  in  this  sense  that  the 

-  -  -  y3 

statistics  0,  <J>  are  necessary  for  the  computation  of  y  . 

Images  of  L  under  homomorphisms  with  successively  larger  kernels 

can  be  realized  by  using  only  certain  of  the  equations  in  the 

finite  dimensional  estimator  (15);  that  is,  some  subset  of  the 

equations  (15)  will  generate  a  Lie  algebra  isomorphic  to  \J  I  .  Let 

Tfj  denote  the  ideal  with  basis  and  B.,  C.,  D.,  i  ^  ji  we  will 

also  use  the  notation  that,  e.g.,  t  D.  denotes  the  ideal  with  basis 

J  *• 

the  above  elements  and  (which  is  in  the  center  of  L) .  Realizations 
of  some  of  the  many  possible  quotients  are  summarized  in  the  following 
table,  which  gives  the  quotient  along  with  the  set  of  states  of  a 
finite  dimensional  estimator  which  realizes  it  (the  filter  states 
satisfy  the  corresponding  equations  in  (15)).  For  example,  l/i  , 
is  realized  by  (15)  with  the  equations  for  $  and  y  omitted,  with 
all  the  other  filter  states  retained. 


IUOTIENT 


REALIZATION 


L/  I4 

l/(I4  e  d3) 

L/(I.  »D.e  D  ,) 
rj*  2  J 
l/( i4  a  d,  a  d  a  d3) 

L/  13 

L/(I3  9  D2) 

l/(i3  a  d  a  d2) 

L/  I2 

l/(i2  a  d  ) 

L/  I, 


Sc,  £,  9.  ©,y  .  4>,  y,  t 

*  A  A  A 

£»  y,  0,  y  »  4>,  t 

A  A  A 

*,  S»  9,  Q,  4>,  t 

A  A  A 

Sc,  S,  0,  4>,  t 

Sc,  i,y,  0,  y  ,  t. 

A  A 

Sc,  C,  9,  0,  t 

A  A 

x,  5,  0,  t 

A 

Sc,  K,  9,  t 
Sc,  5,  t 
Sc,  t 


Table  1 .  Realization  of  some  quotients . 

The  results  of  Table  I  follow  from  two  Observations:  first, 

that  if  I  and  J  are  ideals  of  L  such  that  I  c  J  ,  then  J/I 

is  an  ideal  of  L/I  and  (L/I)  /  (J/l)  is  naturally  isomorphic 

to  L/j  I  I6,p.8]  (e.g.»  I  -  3^  and  J  «=  Ij).  Also,  it  is  clear  that 

if  one  defines  homomorphisms  from  l/3^  to  the  quotients  in  Table  1  by 

the  canonical  map,  then  the  image  can  be  realized  by  (IS)  with  certain 

equations  omitted.  For  example,  it  is  clear  that  sending  d_  0  can 

be  accomplished  by  eliminating  the  equation  for  y  ;  each  d.  thus 

/>  l 

represents,  in  some  sense,  y  .  Notice,  in  particular,  that  A/lj 
is  realized  by  the  Kalman  filter  for  x. 

Other  interesting  quotients  are  obtained  by  homomorphisms  which 
send  other  elements  of  the  center  of  L/^4,  say  just  d^,  to  zero. 
However,  such  a  quotient  is  more  difficult  to  realize  by  an 
estimator,  since  the  realization  is  not  obtained  by  merely 
eliminating  certain  equations.  For  these  quotients,  the  following 
result  leads  to  a  realization. 

Proposition  I:  Let  F  be  the  Lie  algebra  generated  by  two  n-dimensional 
vector  fields  a  and  b.  Assume  that  there  is  an  element  d  in  the 
center  of  F  and  a  constant  n-vector  6  such  that  0’d  ■  I  (prime 
denotes  transpose).  Then  the  mapping  $  with  4(a)  ■  a  -  (B'a)d  and 
4(b)  •  b  -  (3'b)d  extends  to  a  Lie  algebra  homomorphism  with 
4(f)  •  f  -  (0'f)d  for  all  f  £  F,  4(d)  ■  0,  and  <j>(F)  isomorphic  to 
F/{d>. 


Proof:  We  must  show  that,  for  f,g  €  F, 


$([  f,g)>  -  I  f.g)  -  (B't  f,g])d  -  [({.(f),  ♦(g)]. 

Now,  since  B'f  and  B'g  are  functions  (not  constants), 

[♦(f),  ♦(§)]  -  [f-(B'f)d,g-(B'g)d] 

-  tf.g]  “  I  (B'f)d.g)  -  [  f, (B'g)d]  ♦  [  (B'f)d, (3'g)d] 

-  [f.g]  -  ( (B* f )[  d,g)  -  g(B'f)d) 

-  {(B'gUMl  ♦  f(B’g)d) 

♦  {(B’f)(B'g)[  d  ,d  ]  +  (0’f)d(B'g)d  -  (B'g)d(B' f)d} 


Notice  that,  for  any  f  €  F,  $'•[  f ,d)  -  0  and  3(B'd)/3x  *  0  imply  that 

wn  .  J&LDi  -o. 


Thus 


I  ♦(«.«(*)]  -I  f.g]  -  (“  rfB'f)  ♦  f(B'g))d 
-  I  f.g]  -  (B'l  f ,g])d. 

Note  finally  that  ♦(d)  ■  d  -  (B'd)d  *  d  -  d  »  0. 

This  result  can  be  applied,  for  example,  to  F  ■l/3^  and  dj, 
since  dj  is  in  the  center  and  the  third  component  of  dj  equals  1 
(thus  B  •  (0  0  1  0  ...  0]').  The  proposition  implies  that  if  we 
implement  (15)  with  a .  ,b  replaced  by  a  -  (B'a  )d,  and  b  -  (B'b  )dt, 

OO  O  O  I  O  01 

respectively,  then  the  resulting  estimator  (call  it  (15'))  will 

generate  a  Lie  algebra  isomorphic  to  L/(l^  §  D^.  Notice  that  this 

transforma tioi^(due  to  the  form  of  dj)  eliminates  the  $  equation, 

modifies  the  y^  and  y^  equations,  and  does  not  affect  the  others. 

From  another  point  of  view,  the  right-hand  side  of  (15)  is  transformed 

from  a  dt  ♦  b  dz,  to 
o  o  t 

a  dt  ♦  bdi.  -  d,[  (B'a  )dt  ♦  (B'b  )dz  ] 
o  o  t  I  o  o  c 

-  4odt  ♦  bodZt  -  d,djt 


(18) 


Denoting  the  statistics  in  this  estimator  which  replace  y2  and 
^  T  "3  . 

y  by  y  and  y  ,  respectively,  we  see  from  (18)  and  the  form  of  d| 


^2  1  *2  2 

<*yt  *  *yt  ~  2?tdyt  *  dyt  ~  8 


thus  this  estimator  computes  the  conditional  second  central 

2  t  '  "/£'  1 . 

moment  3  (y  -yt)  rat^er  ^an  the  second  moment  y^.  However, 

<v  a  A 
.  3  .3  ,  2,~ 

dyfc  »  dyt  -  3ytdyt 

-  (2Ax£yP  +  A8x0 P  +  2452P2  +  6yPPj2  +  2APPJ3  -  A8£0?2 

-  I2yPPJ3  -  1 2? 2y P2  -  2APP]A  -  2Axy©P  -  A8x$P)dt 

+  (2A0yP+A8$P)dzt 

which  is  not  the  equation  for  any  easily  recognized  statistic  of  the 
conditional  distribution  of  yfc  given  z*.  On  the  other  hand,  the  results 
of  [  17]  -  [  18]  imply  that,  since  there  is  a  Lie  algebra  homomorphism 
from  the  Lie  algebra  F  of  (15)  to  that  of  (15’)  and  the  isotropy 
subalgebra  of  F  is  {0}  at  every  point,  then  there  is  (at  least  locally) 
an  analytic  map  X  that  carries  solutions  of  (15)  into  those  of  (15'). 

AAA 

We  have  already  seen  that  X  takes  the  components  S,  £,  0,  <K  t  into 

2  r 

themselves,  X(y*)  «  (y— y fc)  /zz],  and  X(yt)  -  0.  The  image  X(y£)  is 

difficult  to  compute,  although  a  method  is  given  in  [  17];  to  first 
order  for  small  t,  y  »  y  -  3yz(yt-po),  but  more  complete  calculations 
are  very  involved. 


4.  CONCLUSIONS. 

We  have  presented  one  example  of  the  method  proposed  in  [9]  for 
using  Lie  algebraic  techniques  to  study  nonlinear  estimation  problems 
(a  similar  analysis  can  of  course  be  done  for  other  problems  in  the 
class  discussed  in  [6]  -(8]).  This  method  clarifies  the  relationship 
between  the  computation  of  the  (unnormalized)  conditional  density  and 
the  finite  dimensional  computation  of  certain  statistics  of  the  conditional 
distribution  (in  this  case,  the  conditional  moments).  Although  moments 
of  any  order  can  be  computed  by  a  finite  dimensional  estimator  in  this 
example,  it  is  unresolved  whether  the  same  is  true  of  the  conditional 
density.  That  is,  the  Lie  algebra  of  the  Zakai  equation  (5)  is- 


V*®'*1  ,w. 


infinite  dimensional,  but  that  certainly  does  not  preclude  its 
being  isomorphic  to  a  Lie  algebra  generated  by  two  vector  fields 
on  a  finite  dimensional  manifold  (which  would  be  the  case  if  it 
could  be  computed  in  terms  of  finite  dimensionally  computable 
sufficient  statistics).  However,  since  moments  of  all  orders  can  be 
calculated,  it  may  be  possible  (modulo  questions  such  as  moment 
determinacy)  to  approximate  the  conditional  density  to  any  desired 
degree  of  accuracy  by  means  of  a  series  in  the  finite  dimensionally 
computable  statistics. 

On  the  other  hand,  the  Lie  algebra  of  the  Zakai  equation  may 
have  very  few  ideals,  in  which  case  there  may  be  no  statistics 
which  arc  "more  easily"  computable  than  the  unnormalized  conditional 
density.  Examples  of  both  types  and  further  analysis  along  these 
lines  will  be  presented  in  [  22].  Finally,  we  should  warn  that  Lie 
algebraic  conditions  do  not  always  present  the  whole  picture;  as 
discussed  in  [20],  one  must  essentially  be  able  to  "integrate" 
the  abstract  Lie  algebra  representations  obtained  in  order  to 
actually  construct  the  estimator,  and  this  is  not  always  possible 
(see  [  23]  for  one^further  class  of  systems  for  which  this  jU 
possible) . 
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APPENDIX 


DERIVATION  OF  FINITE  DIMENSIONAL  ESTIMATOR. 

i 

First  we  note  [6,  Appendix  8)  that  if  x  *  [  Xj  ...  x^J  is 
a  Gaussian  random  vector  with  mean  tn  and  covariance  P,  then 


Ux,  ...  xk)  -  U’S.fax,  ...  Xfc.,1  *  nto  six 


(A.I) 


a, -I  I 


V  ] 

“k-1 


Bj  ♦  .  . 


..  m 


m.  +  Z  P^  m  . .  _ 

^  (a,,a2)ala2  a3  “k 


+  («^,a2,a3,a4)  “l"2  “3"4  "5 


P  P  m  ...m  ♦  ,, 

a, a,  a„a,  a, 


where  each  set  (cu,  i  *  I,...,k)  is  a  permutation  of  {l,...,k} 


and  the  sums  in  (A.I)  are  over  all  possible  combinations  of  pairs  of 
the  {a.}.  Now,  x  in  the  problem  (12)  -  (13)  is  conditionally  Gaussian 
with  conditional  cross-covariance  defined  by  (for  Oj,  o2  <_  t) 

P(Oj  »°2»  t)  -  E^(*o1"^0J|t)(x02"*o2|t)lzt,, 

where  8  •  *  E(x  I J ;  using  the  results  of  [6,  section  2]  it  can  be  shown 

o|t  o' 

that 


(A. 2)  dtP(o|*°2,t)  *  “P(0|,t,t)P(o2,t,t) 


(A.  3) 
(A. 4) 


P(0,t,t)  -  K(t,0)Pfc 
~  K(t,o)  -  -P~!K(t ,0)  ;  K(O,0)  -  I 


wher  Pfc  ■  P(t,t,t)  is  the  solution  of  the  Riccati  equation  (16). 
The  conditional  mean  S  t  satisfies  equation  (2)  in  I  to  form: 

(A. 5)  d?t  -  E*lx*]dt  ♦  {E^ ytxtl  -  9t8tM  d*t-8tdt] 


-J-r  ■  ■ 


But  E*t  x^3  -  x*  +  Pt,  and  using  (A.l),  (A. 3),  and  (A. 4), 
E^ytXt^  ”  yt*t  "  ^  xsxt^  ”  xs^xt>ds 


o 
t 

-  /  2P(s,t,t)£  ds 
o  s 


-  25tPt 


where  £  satisfies 


-1 


Thus  the  Kalman  filter  for  the  system  with  states  x ,£  and 

observations  z  computes  x,  and  9  is  computed  according  to  (A. 5), 

thus  yielding  the  first  three  equations  in  (15)  and  P,  PJ2  in  (16) 

(once  they  have  been  converted  to  Fisk-Stratonovich  form). 

2  2 

Furthermore,  since  dyf  «=  2yfcdyt  *  2yfcxtdt,  equation  (2) 
yields 


A  A 

(A. 6)  dy*  -  2Et[ytx^]dt  ♦  {E^y^J  -  yJ*t)(dV*tdt)  * 
Using  (A.  1), 

yfcx*J  •  f  e\  x*x*]ds 

w  C  _  C  8 

O 

-  +  5tP  ♦  4»tCtP  ♦  2PP|2. 


Also,  (A.l)  -  (A. 4)  imply  that 


A 

2  .  2~ 

Vt3  ’  Vt 


t  t 


4  7  7  P(a,t,t)Eti  X  xJjdsdT 
o  o  8  T 

t  t 

-  4  /  /  P(*,t,t)t  S#|tEll  x^)  ♦  2p(s,T,t)*Tjt)dsdT 

t  t  t 

-  4{(  /  P(s,t,t)8  .  d*)J  ♦  2E*t  /  p(s,t,t)(/  p(s,T,t)x  dt)ds)} 

o'  o  o  T 

-  ♦  20tP) 


pWi trm 


where  0  satisfies 


K  “  Pl2xt  +  Ct(P~PPl2)"  P”,0t;  ®o  "  0 
The  Kalman-Bucy  filter  for  the  state  equations  of  x,  £,  and  0  with 

A  A  2  , 

observation  z  computes  Sct*  ©t»  snd  yt  is  computed  according  to 
(A. 6).  After  correction  terms  are  added,  these  result  in  the  first 
five  equations  in  (15),  and  the  first  three  in  (16)»  The  third 
moment  y  ( and  higher  moments)  are  computed  in  a  similar  maimer. 
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